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ABSTRACT 

Higher-order  transform  blind  signal  feature 
classification  is  discussed  for  separating  bar-shaped, 
circular,  squared,  circular- squared,  and  offset-diamonded 
constellation  patterns  of  digital  linear  signals.  This 
technique  is  used  for  automatic  modulation  classification 
of  unknown  signals.  The  higher-order  transform 
technique  is  powerful  in  distinguishing  the  geometrical 
patterns  of  the  signal  constellations  and  can  be  used  to 
sort  a  large  amount  of  modulation  schemes  into  several 
pattern  groups  with  smaller  amount  of  modulation 
schemes  so  a  fine  modulation  classification  can  be 
performed  more  effectively  and  reliably  on  each  pattern 
group.  Robustness  of  higher-order  cumulants  is  discussed 
to  show  that  the  constellation  pattern  separation  is  less 
sensitive  to  variations  in  signal-to-noise  ratio. 


1.  INTRODUCTION 

Blind  signal  separation  (BSS)  is  a  critical 
technology  for  battlefield  situation  awareness  based 
upon  the  tracking  of  RF  transmissions  from  friendly, 
hostile,  and  non-combatant  emitters.  Within  BSS, 
automatic  modulation  feature  separation  and  recognition 
is  a  key  step  in  classifying  signals  without  prior 
knowledge  of  the  emitters.  With  the  emergence  of 
software-defined  radios  and  cognitive  radios,  BSS 
becomes  an  attractive  research  topic  in  commercial 
applications.  The  concept  is  to  exploit  the  radio 
transmission  environment  and  choose  the  best 
modulation  scheme  to  maximize  the  channel  capacity 
and  minimize  interference  in  real  time.  In  cognitive 
radios,  the  signal  data  can  be  transmitted  frame  by  frame 
and  the  modulation  scheme  in  each  data  frame  can  be 
determined  depending  upon  the  channel  quality  to  insure 
the  adaptive  modulation  scheme  maintains  the  BER 
below  a  certain  threshold  to  ensure  the  QoS  in  data 
transmission.  Recently,  many  research  results  have  been 
published  (Su  et  al.,  2002a,  2006)  on  migrating  military 
BSS  to  commercial  applications  in  selecting  the 
modulation  schemes  automatically  without  the 
redundant  pilot  symbols.  A  common  practice  is  to 
embed  an  automated  modulation  estimator  into  the 
receiver  of  a  SDR  as  shown  in  Figure  1.  The  modulation 
estimator  works  in  parallel  with  a  programmable 


demodulator  in  the  receiver.  A  change  in  the  modulation 
scheme  of  the  transmitter  in  each  data  frame  will  be 
detected  and  the  demodulator  will  be  cued  to  change  the 
demodulation  scheme  accordingly.  The  modulation 
estimator  classifies  modulation  schemes  by  comparing 
the  unknown  signal  to  known  templates.  The  reliability 
of  the  estimation  largely  depends  on  the  crowdedness  of 
the  signal  space  or  the  size  of  the  template  library.  The 
higher-order  transform  (HOT)  is  a  popular  technique 
adopted  to  separate  unknown  signals.  HOT  may  include 
power-law  (DeSimio  and  Glenn,  1988),  moments, 
cumulants  (Swami  and  Sadler,  2000),  and  cyclic 
cumulants  (Spooner,  2001;  Dobre  et  al.,  2003) 
approaches  which  can  be  used  to  recognize  modulation 
types  such  as  PSK  and  squared-QAM.  The  PSK 
constellations  have  circular  amplitudes  with  evenly 
distributed  phases,  while  the  squared-QAM 
constellations  have  square  amplitudes  and  dominant 
phases  (at  +45°  and  +135°).  Such  features  can  be 
extracted  using  HOT  approaches.  Our  work  applies 
HOT  techniques  to  a  larger  variety  of  signals  by 
including  circular-squared-QAM  (CSQ)  described  by 
MIL-STD-188  1 10B  (DoD  Interface  Standard,  2000). 
The  CSQ  constellations  have  higher-power  unevenly- 
phased  circular  amplitudes  together  with  lower-power 
squares  and  are  relatively  featureless  to  many 
constellation  recognition  methods.  Thus,  a  constellation 
pattern  separation  technique  is  developed  to  sort  the 
unknown  signals  to  five  geometrical  groups:  bar,  circle, 
square,  offset-diamond,  and  circular- square  with  no 
prior  knowledge  of  the  modulation  schemes,  so  that  fine 
modulation  recognition  methods  can  be  applied  to  each 
geometrical  group  with  much  less  crowded  signal  space. 
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Figure  1.  Modulation  classification  for  SDR 
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2.  HIGHER  ORDER  TRANSFORM  FEATURES 

For  a  linearly  modulated  signal  transmitted  through 
a  flat  fading  AWGN  channel,  the  digitized  signal  at  the 
communication  receiver  can  be  approximately  described 
as: 

u(k)  =  acej(2^nT+,p)  ^  angT  (y  -  n)T  +  wn  (1) 

n=\  l 

where  A  is  a  positive  integer,  wn  is  the  AWGN,  T  is  the 
symbol  rate,  Ts  is  the  sample  rate,  l=T/Ts  is  the  over- 
sampling  factor,  an  is  a  complex  number  represents  the 
n-th  symbol,  gT  (•)  is  the  square-root  pulse  with 
unknown  shape  and  roll-off  factor,  fc  is  the  residual 
carrier  frequency,  a  c  is  the  channel  gain,  and  cp  is  the 

combination  of  carrier  and  channel  phases.  In 
cooperative  communication,  the  receiver  down-coverts 
and  matched-filters  the  RF  signal  based  on  prior 
knowledge  of  the  carrier  frequency,  symbol  rate, 
bandwidth,  pulse  shape,  etc.  The  symbol  timing,  carrier 
phase,  and  channel  distortion  can  be  estimated  by 
training  sequences  or  hand  shaking  between  transmitter 
and  receiver. 

In  non-cooperative  communication  cases  such  as 
signal  interception  and  hostile  signal  detection,  the 
ground  truth  of  the  transmitter  is  unknown  and  the 
training  sequences  are  not  available.  The  non- 
cooperative  RF  receiver  has  to  estimate  the  unknown 
parameters  of  the  transmitted  signals,  make  hypothesis 
on  modulation  schemes,  and  propose  the  best  statistical 
decisions. 
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Figure  2.  Modulation  classification  block  diagram 


As  shown  in  figure  2,  the  frequency  down  converter 
brings  the  RF  signal  to  near-baseband  with  a  low-pass 
filter  based  on  the  coarse  estimation  of  spectral  center 
frequency  and  bandwidth.  The  down  converted  signal  in 
complex  format  is  over-sampled  (for  example:  4  samples 
per  symbol)  to  provide  sufficient  resolution  in  signal 
processing.  Then,  a  snapshot  of  N  digital  samples  are 
extracted  and  buffered  for  digital  signal  processing. 
Before  applying  HOT  techniques  for  signal  separation, 


the  carrier  frequency  offset  and  carrier  phase  offset  have 
to  be  estimated  and  removed,  the  amplitude  of  the  signal 
has  to  be  normalized,  and  the  channel  effects  have  to  be 
compensated.  After  IF  signal  conditioning,  the  signal 
can  be  described  by 

x(k)  =  YjangT(j-n)T  +  w„  (2) 

n= 1  l 

where  wn  is  the  additive  noise  assumed  to  be  Gaussian 
after  conditioning,  an  is  the  unknown  symbol  which 
belongs  to  an  alphabet  set  Aj  =  {aj,  aj,  •••  aj)  •  For 
modulation  classification  purposes,  we  assume  there  are 
J  number  of  signals  of  interest,  which  are  indexed  by 
j=l,  2,  J,  and  listed  in  the  reference  library  of  the 

classifier.  Signals  not  listed  will  be  rejected  and 
classified  as  unknowns.  Therefore,  the  notation  aj 

stands  for  the  ith  alphabet  of  the  jth  signal,  which  forms 
the  jth  constellation  of  dimension  I.  The  value  of  aj  is 

normalized  to 

I  bib1 

2=1 

for  all  j.  The  signals  of  interest  are  described  by  the 
following:  bar-shaped  constellation:  PSK2,  as  shown  in 
figure  3,  circular  constellations:  PSK8  and  PSK16  as 
shown  in  figure  5,  squared  constellations:  PSK4, 
QAM16,  QAM64,  and  QAM256,  as  shown  in  figure  6, 
circular-squared  constellations:  QAM  16m,  QAM32m, 
and  QAM64m,  and  crossed  constellation:  QAM32  as 
shown  in  figure  7,  and  offset-diamonded  constellations: 
V29-8  and  V29-16  as  shown  in  figure  8. 


Figure  3.  Bar-shaped  Figure  4.  The  4th  order  bar- 

constellation  pattern  shaped  constellation  pattern 


Figure  5.  Circular  constellation  patterns 
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Figure  6.  Squared  constellation  patterns 


1.5 

1 

0.5 

0 

■0.5 

-1 

-1.5 


1.5 

1 

0.5 

0 

-0.5 

-1 

-1.5 


«i  ®  ® 

®  ®  i® 

®i  $  $ 

®  ®  j$ 

«■  ®  ® 

#  #  j® 

®  ®  ® 

®  ®  i® 

■■"I'®"®' 

-1  0  1 


:  .  ® 
_ L .  --- 

®  : 

L  7! .  .  L _ 

4  ®  ® 

®  ®  # 

® :  ®  ® 

®  ®  :  ® 

®  j  ®  ® 

®  ®  :  ® 

4  ®  ® 

®  ®  ® 

i  ‘sj?  _ 

:  # 

T  ’if?  1 
®  ; 

-1  0  1 


fc. . . 

L _ 4 

$ 

® 

l"l'l 

® 

® 

fe' . . 

L_.® _ 

L  ^ 

L _ ®.  .  . 

'  tin  ^ 

$  ®  $  $ 

®  ®  ®  ® 

di  i 

L®*®.L... 

®  ®  ®  4 

®r®-®-^»- 

®  *  * 

^  #  «  « 
--®-|-®-®-® 
*  *  ® 

:  *  $ 

®  ®  ® 
l®_®®_L®_ 

®  ®  ®  f» 

&  ®  : 

Figure  7.  Circular-squared  constellation  patterns 


constellations  so  that  the  features  of  the  constellations 
can  be  observed.  Figure  4,  9-12  demonstrated 

constellations  of  the  4th  order  power-law  f  of  the 

alphabet  aj  for  i=l,  2,  ...,  I  and  j=l,  2,  J.  Examining 

those  4th  order  power-law  results,  we  observe  that  the 
bar-shaped  pattern  has  a  positive  real  value.  The  circular 
patterns  are  still  circular  in  shape  but  only  contain  one 
fourth  of  the  constellation  points,  the  squared  patterns 
always  have  negative  real  values  as  dominant  dots,  the 
circular-squared  patterns  are  all  centered  at  the  origin, 
and  the  offset-diamonded  patterns  have  a  bar-shape 
pattern  which  has  more  weight  in  the  positive  real  part. 
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Figure  9.  The  4th  order  power-law  circular  constellation  patterns 


Figure  10.  The  4th  order  power-law  squared  shaped  constellation 
patterns 


Figure  8.  Offset-diamonded  constellation  patterns 

The  power-law  technique  (DeSimio  and  Glenn,  1988)  is 
used  to  transform  the  geometrical  patterns  of  the 


If  superimposing  figures  5-8  to  figure  3  and 
superimposing  figure  9-12  to  figure  4,  as  shown  in 
figure  13  and  14,  respectively,  we  notice  that  the 
alphabet  signal  space  of  the  4th  order  power-law  is  much 
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less  crowded  and  the  classification  of  different  alphabet 
sets  (modulation  schemes)  will  be  more  reliable. 


Figure  11.  The  4th  order  power-law  circular-squared  constellation 
Patterns 


Figure  12  The  4th  order  power-law  offset-diamond  shaped  constellation 
Patterns 


The  high-order  features  can  be  measured  by 
calculating  complex  moments  of  a{  denoted  by 

mjpq(al)->  where  p  and  q  are  the  order  and  the  complex 

conjugate  order  of  the  moment.  For  example  mJ20(aJ)  of 

the  bar-shaped  alphabet  constellation  pattern,  such  as 
PSK2,  is  nonzero  but  mJ20(a /)  of  all  other  alphabets  of 

constellation  patterns  are  zero.  Therefore,  bar- shaped 
constellation  patterns  can  be  easily  separated  from 


others.  Furthermore,  the  PSK4,  PSK8,  PSK16 
constellations  can  be  identified  by  using  mJ40(a]), 

j  and  m/6>0(a/),  respectively,  so  that  the  circular 
patterns  can  also  be  separated  from  other  patterns. 


The  jth  constellation  has  its  own  moment  mJ40(a])  •  If 
a  noisy  sequence  x  belongs  to  mJ40(a /)  but  the  index  j  is 
unknown  to  the  user,  we  can  calculate  m40(x)  and  match 
it  to  the  known  moment  mj40{a{)^  j=k  2,  for  the 

best  fit.  Unfortunately,  the  moment  operation  also 
amplifies  unwanted  additive  noise  and  thus  is  not 
practical  in  low  SNR  applications.  The  cumulants  test 
(Swami  and  Sadler,  2000)  is  a  more  robust  solution  by 
combining  various  orders  of  moments  with  a  given 
formula  (Mendel,  J.,  1991).  Unlike  moments,  the 
higher-order  cumulants  are  theoretically  immunized 
from  the  additive  Gaussian  noise  since  the  higher-order 
cumulants  of  a  signal  plus  noise  equal  the  cumulants  of 
the  signal  plus  the  cumulants  of  the  noise,  and  the  latter 
vanishes  if  it  is  Gaussian.  This  makes  the  higher-order 
cumulants  insensitive  to  the  additive  noise  even  if  that 
noise  is  colored  (Mendel,  J.,  1991).  The  cumulant  of  a 
random  valuable  x  is  denoted  by  cpq(x),  where  p  and  q 
are  the  order  and  the  complex  conjugate  order  of  the 
cumulants.  Although  the  cumulants  can  be  computed  by 
the  nonlinear  combination  of  moments,  the  theoretical 
values  are  difficult  to  obtain  in  practice.  For  example, 
the  4th  order  cumulant  c40(x)  is  computed  by 

c40  (x)  =  m40  (x)  -  3m220  (x)  =  J x4/ (x)dx  -  3(j x2/ (x)dx)  ? 

(3) 

where  f(x)  is  the  distribution  of  the  random  valuable  x.  In 
practice,  only  a  finite  number  of  discrete  variables,  x(k), 
are  available.  The  4th  order  moment  and  cumulant  of  the 
unknown  valuables  are  then  estimated  by  the  time- 
average  of  a  finite  sequence  as  shown  below: 

m40  O)  *  m40  =  ^  x4  (k)  (4) 

k= 1 


)0)! 


\x4{k) 


f  N 


I>2(*) 


(5) 


k= i  v*=i  y 

In  order  to  investigate  the  performance  change  by  using 
the  estimated  cumulant  c40 ,  a  computer  simulation  of  the 
higher  order  transform  of  Gaussian  noise  for  both 
moment  m40  and  cumulant  c40  are  conducted  from  0  to 
20  dBW.  The  simulation  shows  that  the  value  of  the  4th 
order  moment  m40  is  decreased  at  lower  SNRs  but  the 
value  of  the  4th  order  cumulant  c40  is  relatively 
unchanged.  However,  when  the  length  of  the  sample  is 
reduced,  the  performance  of  the  cumulants  becomes 
degraded.  We  observe  that  the  4th  order  cumulant  c40  of 
Gaussian  noise  with  1 ,000  samples  is  less  stable  than  the 
same  noise  model  with  1,000,000  samples. 
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Figure  13.  Constellation  pattern  space 


Figure  14.  The  4th  order  power-law  constellation  pattern  space 


3.  SIGNAL  FEATURE  SPACE 

The  objective  of  HOT  approaches  is  to  transform 
the  modulation  feather  such  as  amplitude  and  phase  to  a 
more  classification  friendly  domain.  To  show  this,  we 
calculated  the  cumulants  c20,  c2i  c40,  c4i,  c42,  c6o,  c6i,  c62, 
C63?  c80,  c8i,  c82,  c83,  and  c84  for  the  alphabets  of 
modulation  schemes:  QPSK;  PSK8,  PSK16,  QAM16, 
QAM64,  QAM32,  QAM  16m,  QAM32m,  QAM64m; 
V29-8,  and  V29-16;  where  a  modulation  type  ending 
with  ‘m’  represents  the  MIL-STD-188  110B  CSQ 
signals.  The  HOT  feature  space  can  be  displayed  as  a 
three-dimensional  feature  space  where  the  x-axis  denotes 
modulation  schemes,  the  y-axis  denotes  the  types  of 
cumulants,  and  the  z-axis  shows  the  values  of  cumulants. 
The  constellation  patterns  are  distinct  for  each  type  and 
thus  can  be  used  to  group  modulation  schemes  in  the 
feature  space.  This  can  be  illustrated  as  a  family  of  2D 
plots  for  recognition  analysis  as  shown  in  Figures  15, 
where  the  x-axis  represents  the  type  of  cumulants,  and 
the  y-axis  represents  the  values  of  cumulants  normalized 
to  between  0  and  1 .  Conventional  approaches  to 


recognize  modulation  schemes  would  attempt  to 
maximize  the  likelihood  of  template  matching  between 
the  cumulant  of  unknown  noisy  data  and  the  cumulant  of 
known  alphabets  of  modulation  schemes.  This  will  not 
work  very  well  since  some  values  of  the  cumulants,  as 
shown  in  figure  15,  are  too  close  to  call. 


Figure  15.  Modulation  schemes  vs.  cumulants 


The  modulation  properties  in  Figure  15  are  not 
evenly  spaced  over  the  feature  space,  rather,  they  are 
better  grouped  into  five  sets:  {PSK2},  {PSK8, 
PPSK16},  {QPSK,  QAM  16,  QAM64,},  {QAM32, 
QAM  16m,  QAM32m,  QAM64m},  and  {V29-8,  V29- 
16}  as  shown  in  Figure  16-20,  respectively. 


Figure  16.  Bar-shaped  modulation  schemes  vs.  cumulants 


Figure  17.  Circular  modulation  schemes  vs.  cumulants 
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Figure  18.  Squared  modulation  schemes  vs.  cumulants 


C20,  C21A0A1A2A0, 061,062,063,080,081,082,083,084 

Figure  19.  Circular-squared  modulation  schemes  vs.  cumulants 


Figure  20.  Diamonded  modulation  schemes  vs.  cumulants 

This  leads  naturally  to  a  two-stage  recognition  process. 
The  first  stage  is  a  geometrical  pattern  separation  that  is 
critical  to  dividing  signal  modulation  constellations  into 
‘bar’,  ‘circular,’  ‘squared’,  ‘circular-squared’  and 
‘offset-diamonded’  types.  Then  it  is  followed  by  a  fine 
separation  stage  that  concentrates  on  the  mathematical 
estimation  of  HOT  features  within  the  group.  A  brief 
hierarchical  decision  tree  is  shown  in  Figure  21.  We 


notice  that  the  cumulants  can  be  grouped  into  five  sets 
Cl={c40,  c6i,  c82},  C2={c20,  c4i,  c60,  c62,  Cgi,  c83}, 
C3={c42,  c63,  c84},  and  C4={c80}  based  on  the  similarity 
in  values.  For  example,  in  set  Cl,  the  values  of  c40,  c6i, 
and  c82  are  almost  equal  in  values.  Therefore  if  c40  is 
used,  c6i  and  c82  will  be  considered  as  redundant  features 
(which  are  not  significant  in  providing  new 
information).  Since  the  elements  in  set  C2  are  identical 
for  all  modulation  schemes,  it  will  not  contribute  in 
classification.  The  useful  features  are  narrowed  down  to 
c40,  c42,  and  c80.  The  previous  section  has  discussed  how 
to  extract  bar- shaped  and  circular  pattern  by  using 
moments,  the  same  approach  can  be  extended  here  by 
using  4th  order  cumulants  to  separate  squared,  circular- 
squared,  and  offset-diamonded  patterns. 


Figure  21.  Modulation  feature  separation  decision  tree 


4.  MODULATION  PATTERN  SEPARATION 

The  4th  order  cumulant  c40  reduces  the  symmetry  of 
the  constellation  patterns  so  that  constellation  points 
lying  on  the  +45°  and  +135°  lines  will  be  emphasized  for 
separating  patterns  into  three  groups:  square,  circular- 
square,  and  offset-diamond.  The  4th  order  cumulant  c42 
captures  the  amplitude  of  the  constellations.  Figure  22 
demonstrates  values  of  normalized  c40  versus  SNRs  for 
the  signals  described  by  Equation  2  with  modulation 
schemes  of  QPSK,  PSK8,  PSK16,  QAM  16,  QAM64, 
QAM32,  QAM  16m,  QAM32m,  QAM64m,  V29-8,  and 
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V29-16.  A  block  of  1,000  symbols  are  used  which  is 
over-sampled  to  4  samples  per  symbol.  Monte  Carlo 
simulation  is  conducted.  From  the  top  down  in  figure  25, 
the  first  stripe  is  values  of  c40  versus  SNR  for  1,000 
trials  of  all  squared  modulation  schemes,  the  second 
stripe  contains  1,000  trials  of  all  circular  modulation 
schemes,  and  1 ,000  trials  of  circular-squared  modulation 
schemes,  in  which  the  circular  types  can  be  further 
separated  by  using  c8o  and  Ci6,o,  as  mentioned  before,  the 
third  and  the  forth  stripes  are  for  1,000  trials  of  offset- 
diamond  modulation  schemes,  where  the  third  one  is  for 
V29-16,  and  the  forth  one  is  for  V29-8.  Notice  that  those 
stripes  are  quite  flat,  clearly  separated,  and  insensitive  to 
SNRs  above  4dB  (SNR  is  defined  over  the  sampling 
bandwidth).  Therefore,  the  constellation  pattern  can  be 
reliably  separated.  Simulation  shows  that  if  4,000 
symbols  are  used,  the  stripes  will  be  separated  even 
below  4dB  SNR.  Since  the  noiseless  values  of 
normalized  c40s  are  known  for  all  modulation  schemes, 
least-mean-square  error  test  or  many  other  methods  can 
be  used  to  classify  the  patterns  automatically.  Once  the 
patterns  are  recognized,  a  fine  modulation  classification 
method  can  be  used  for  further  classification.  Many  fine 
modulation  recognition  methods  are  available  and  we 
will  not  discuss  them  here.  However,  it  is  remarkable 
that  in  this  new  approach,  the  fine  recognition  process 
will  apply  to  a  much  less  crowded  signal  space  to 
achieve  the  better  performance. 


SNR  in  DE! 

Figure  22.  c4qVS.  SNR 


CONCLUSION 

The  performance  of  the  modulation  classification 
largely  depends  on  the  distances  in  the  signal  space.  The 
new  higher-order  signal  constellation  pattern  separation 
method  sorts  the  signal  into  several  groups  so  that  the 
signal  space  in  each  group  is  less  crowded.  Circular- 
squared  constellation  pattern  can  be  classified  to  bar¬ 
shaped,  circular,  squared,  and  offset-diamond 
constellation  patterns  by  using  the  4th  order  cumulants. 
The  high-order  method  may  not  be  effective  in 
identifying  a  specific  modulation  scheme  but  it  is  very 
powerful  in  separating  geometrical  patterns  of 
constellations  for  linear  modulated  digital  signals. 
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